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Abstract. Several old and recent classes of picture grammars, that variously ex- 
tend context-free string grammars in two dimensions, are based on rules that 
rewrite arrays of pixels. Such grammars can be unified and extended using a tiling 
based approach, whereby the right part of a rule is formalized by means of a finite 
set of permitted tiles. We focus on a simple type of tiling, named regional, and de- 
fine the corresponding regional tile grammars. They include both Siromoney's (or 
Matz's) Kolam grammars and their generalization by Priisa, as well as Drewes's 
grid grammars. Regionally defined pictures can be recognized with polynomial- 
time complexity by an algorithm extending the CKY one for strings. Regional 
tile grammars and languages are strictly included into our previous tile grammars 
and languages, and are incomparable with Giammarresi-Restivo tiling systems 
(or Wang systems). 

Keywords: picture language, tiling, picture grammar, 2D language, CKY al- 
gorithm, syntactic pattern recognition. 



1 Introduction 

Since the early days of formal language theory, considerable research effort has been 
spent towards the objective of extending grammar based approaches from one to two 
dimensions (2D), i.e., from string languages to picture languages. Several approaches 
have been proposed (and sometimes re-proposed) in the course of the years, which in 
different ways take inspiration from regular expressions and from Chomsky's string 
grammars, but, to the best of our knowledge, no general classification or detailed com- 
parison of picture grammars has been attempted. It is fair to say that the immense suc- 
cess of grammar-based approaches for strings, e.g. in compilation and natural language 
processing, is far from being matched by picture grammars. Several causes for this 
may exist. First, the lack of broadly accepted reference models has caused a disper- 
sion of research efforts. Second, the algorithmic complexity of parsing algorithm for 
2D languages has rarely been considered, and very few efficient algorithms, and fewer 
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implementations, exist. Last, but not least, most grammar types have been invented by 
theoreticians and their applicabihty in picture or image processing remains to be seen. 

We try to remove, or at least to partially offset, the first two causes, thus hoping to set 
in this way the ground for apphed research on picture grammars. First, we offer a new 
simple unifying approach encompassing most existing grammar models, based on the 
notion of picture tiling. Then, we introduce a new type of grammar, called regional that 
is more expressive than several existing types, yet it offers a polynomial-time parsing 
algorithm. 

We outhne how several classical models of picture grammars based on array rewrit- 
ing rules can be unified by a tiUng based approach. A typical rewriting rule replaces a 
pixel array, occurring in some position in the picture, by a right part, which is a pixel 
array of equal size. Each grammar type considers different forms of rewriting rules, that 
we show how can be formalized using more or less general sets of tiles. In particular, 
we focus on a simple type of tile sets, those of regional tile grammars. This new class 
generalizes some classical models, yet it is proved to pernut efficient, polynomial-time 
recognition of pictures by an approach extending the classical Cocke- Kasami- Younger 
(CKY) algorithm [23] of context-free (CF) string languages. 

From the standpoint of more powerful grammar models, regional tile grammars 
correspond to a natural restriction of our previous tile (rewriting) grammars (TG) [4, 
3]. For such grammars, a rule replaces a rectangular area filled with a nonterminal 
symbol with a picture belonging to the language defined by a specified set of tiles over 
terminal or nonterminal symbols. It is known that the TG family dominates the family 
of languages defined by the tiling systems (TS) of Giammarresi and Restivo [10] (which 
are equivalent to Wang systems [1][6]), and that the latter are NP-complete with respect 
to picture recognition time complexity. The new model enforces the consttaint that the 
local language used to specify the right part of a rule is made by assembling a finite 
number of homogeneous rectangular pictures. Such tihng is related to Simplot's [20] 
interesting closure operation on pictures. 

Regional tile grammars are then shown to dominate other grammar types. The first 
is the classical Kolam grammar type of Siromoney [22] (which, in its context-free form, 
is equivalent to the grammars of Matz [15]); it is less general because the right parts of 
grammar rules must be tiled in ways decomposable as vertical and horizontal concate- 
nations. Three other grammar families are then shown to be less general: Prusa's type 
[18], grid grammars [8], and context-free matrix grammars [21]. The language inclu- 
sion properties for all the above families are thus clarified. 

The presentation continues in Section 2 with prehminary definitions, then in Sec- 
tions 3 and 4 with the definition of tile grammars, their regional variant, and relevant 
examples. In Section 4. 1 we present the parsing algorithm and prove its correctness and 
complexity. In Section 5 we compare regional tile grammars and languages with other 
picture language families. The paper concludes by summarizing the main results. 

2 Basic definitions 

The following notation and definitions are mostly from [11] and [4]. 



2 



Definition 1. Let S be a finite alphabet A two-dimensional array of elements of S is 
a picture over S. The set of all pictures over S is 17++. A picture language is a subset 
ofE++. 

For h,k > 1, E^^'''^ denotes the set of pictures of size {h, k) (we will use the nota- 
tion \p\ = [h, k), \p\row = h, \p\coi = k). # ^ S is used when needed as a boundary 
symbol; p refers to the bordered version of picture p. That is, forp e it is 

# # • • • # # 
p(l,l) ...p{l,k) # p{l,l) . . . p{l,k) # 

P= P= ': ': '■■ : : 

Pih,l)...pih,k) #pih,l)...p{h,k)# 

##•••## 

A pixel is an element p{i, j) of p. If all pixels are identical to C G S the picture is 
called C-homogeneous or C -picture. 

Row and column concatenations are denoted Q and CD, respectively, p Q q is de- 
fined iffp and q have the same number of cohimns; the resulting picture is the vertical 
juxtaposition ofp over q. p'^^ is the vertical juxtaposition ofk copies of p; p+® is the 
corresponding closure. O,*^® ,+® are the column analogous. 

Definition 2. Let p be a picture over S. The domain of a picture p is the set dom(p) = 
{1,2,..., |p|rotu} X {1,2,..., IpIco/}- a subdomain o/dom(p) is a set d of the form 
{x.x+l, . . . ,x'}^{y,y+l, . . . ,y'} wherel < x < x' < \p\row, ^ < U < y' < \p\col- 
We will often denote a subdomain by using its top-left and bottom-right coordinates, in 
the previous case the quadruple (x, y: x' , y'). 

The set of subdomains of p is denoted D{p). Let d, = {x. . . . . x'} x {y. . . . , y'} £ 
D{p), the subpicture spic(j>,d) associated to d is the picture of size {x' — x-\-l, y' — y-\- 
1) such that Vz G {1, . . . , a;' — a; + 1} and Vj € {1, . . . , y' — y + 1}, spic(p, d){i, j) = 
p(x + /■ - l.y + j - 1). 

A subdomain is called C-homogeneous ( or homogeneous) when its associated sub- 
picture is a C -picture. C is called the label of the subdomain. 

Two subdomains da = {ia, ja] ka,la) and db = {ib, jb',kb,lb) are horizontally adja- 
cent frei/?. vertically adjacent) iff jb = /a + 1, and kb >ia,ka > ib (resp. ib = ka-\- 1, 
and lb > jai la > jb)- We will call two subdomains adjacent, if they are either vertically 
or horizontally adjacent 

The translation of a subdomain d = {x, y; x', y') by displacement (a, h) e is the 
subdomain d' = {x -\- a,y -\- b; x' -\- a, y' + h). We will write d' = d® (a, b). 

Definitions. Ahomogeneous^&r^^on of a picture pis any partition -k = {di,d2, ■ ■ ■ 
o/dom(p) into homogeneous subdomains di, d2, . . . , d.^. 

The unit partition of p, written unit(p), is the homogeneous partition of doia.{p) 
defined by single pixels. 

An homogeneous partition is called strong if adjacent subdomains have different 
labels. 

We observe that if a picture p admits a strong homogeneous partition of dom(p) 
into subdomains, then the partition is unique and will be denoted by 11 (p). 
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To illustrate, all the pictures in Figure 2 but the last two admit a strong homogeneous 
partition, which is depicted by outhning the borders of the subdomains. The marked 
partitions of the last two pictures are homogeneous but not strong, because some adja- 
cent subdomains hold the same letter. 

We now introduce the central concepts of tile, and local language. 

Definition 4. We call tile a square picture of size (2,2). We denote by |p] the set of all 
tiles contained in a picture p. 

Let S be a finite alphabet. A (two-dimensional) language L C is local if there 
exists a finite set 9 of tiles over the alphabet S U {#} such that L = {p € 17++ | |p] C 
6}. We will refer to such language as L0C(9). 

Locally testable languages (LT) are analogous to local languages, but are defined 
through square tiles with side size possibly bigger than 2. In the rest of the paper we 
will call these variant of tiles k- tiles, to avoid confusion with standard 2x2 tiles. For 
instance, 3 -tiles are square pictures of size (3,3). 

Last, we define tiling systems (TS). Tiling systems define the closure w.r.t. alpha- 
betic projection of local languages, and are presented and studied extensively in [1 1]. 

Definition 5. A tiling system (TS) is a 4-tuple T = (S, F, 6, n), where E and F are 
two finite alphabets, 9 is a finite set of tiles over the alphabet F U {#}, and tt : F ^ S 
is a projection. 

The language defined by the tiling system T (in the rest denoted by L{T)) is the set of 
pictures {7r(p) | p G LOC(9)}. 

3 Tile grammars 

We are going to introduce and study a very general grammar type specified by a set of 
rewriting rules (or productions). A typical rule has a left and a right part, both pictures 
of unspecified but equal (isometric) size. The left part is an A-homogeneous picture, 
where A is a nonterminal symbol. The right part is a picture of a local language over 
nonterminal symbols. Thus a rule is a scheme defining a possibly unbounded number 
of isometric pairs: left picture, right picture. In addition there are simpler rules whose 
right part is a single terminal. 

The derivation process of a picture starts from a S'(axiom)-homogeneous picture. 
At each step, an ^-homogeneous subpicture is replaced with an isometric picture of 
the local language, defined by the right part of a rule A ^ .... The process terminates 
when all nonterminals have been eliminated from the current picture. 

For simplicity, this presentation focuses on nonterminal rules, thus excluding for 
instance that both terminal and nonterminal symbols are in the same right part. This 
normalization has a cost in terms of grammar dimension and readability, but does not 
lose generahty. Indeed, more general kinds of rules (e.g. hke those used in [4]), can be 
easily simplified by introducing some auxiliary nonterminals and rules. We will present 
and use analogous transformations when comparing with other grammar devices in 
Section 5, where we will talk about nonterminal normal forms. 
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Defuiition 6. A tile grammar (TG) is a tuple {S, N, S, R), where S is the terminal 
alphabet, N is a set o/nonterminal symbols, S € N is the starting symbol, R is a set of 
rules. 

Let A € N. There are two kinds of rules: 



Variable size: oj is a set of non-concave tiles over N U {#}. (2) 



tiles only for borders). It is easy to see that all pictures in LOC{u)), where w is a set of 
non-concave tiles, admit a strong homogeneous partition. 

Picture derivation is next defined as a relation between partitioned pictures. 

Definition 7. Consider a tile grammar G = {E, N, S, R), letp,p' e (r U A/')(^''=) be 
pictures of identical size. Let tt = {di, . . . ,dn} be a homogeneous partition o/dom(p). 
We say that {p', tt') derives in one step from {p, tt), written 



iff, for some A ^ N, there exist in tt an A-homogeneous subdomain di = (x, y: x', y'), 
called application area, and a rule A ^ a & R such that p' is obtained substituting 
spic(p, di) in p with: 

- a & S, if A — >■ a is of type (1);^ 

- s e LOC{a), if A a is of type (2). 

Moreover, tt' = (tt \ {di}) U (77(s) ®{x-l,y- 1)). 

We say that {p' , tt') derives from (p, tt) in n steps, written (p, tt) =^q ip\ 7r')> 'ffP — P' 
and TT = tt', when n = 0, or there are a picture p" and a homogeneous partition tt" 
such that {p,Tr) =>g {p" ,t^") and {p",tt") (p',7r'). We use the abbreviation 
{p, tt) =S>g {p', '^')for a derivation with a finite number of steps. 

Roughly speaking, at each step of the derivation an A-homogeneous subpicture is 
replaced with an isometric picture of the local language, defined by the right part of a 
rule A a, that admits a strong homogeneous partition. The process terminates when 
all nonterminals have been eliminated from the current picture. 

In the rest of the paper, and when considering also other grammatical devices, we 
will drop the G symbol when it is clear from the context, writing e.g. {p, n) =4> {p' , tt'). 

Definition 8. The picture language defined by a grammar G (written L{G)) is the set 
ofp £ such that 



Fixed size: A ^ t, where t € S; 



(1) 



Concave tiles are hke 



B B 
C B 



or a rotation thereof, where B ^ # (so we use concave 



(p,7r) =>G (p'.tt') 




For short we also write S =>g P- 



' In this case, x = x' and y = y'. 
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We emphasize that, to generate a picture of a certain dimension, one must start from 
a picture of the same dimension. 

We also will use the notation C{X) to denote the class of languages generated by 
some formal device X, e.g. C{TG) will denote the class of languages generated by tile 
grammars. 

The following examples will be used later for comparing language fanaiUes. 

Example 1. One row and one column ofh's. 

The set of pictures having one row and one column (both not at the border) that hold 
6's, and the remainder of the picture filled with a's is defined by the tile grammar G\ in 
Figure 1, where the nonterminals are {A\, A2, A3, A4, Vi, V2, Hi,H2, X, A, B}. We 



Gi 



X 



##### 
#AXX# 

##### 



####### 

# Ai Ai Vi A2 A2 # 

# ^1 4i Vi A2 A2 # 

# m Hi Vi H2 H2 # 

# A3 A3 V2 Ai Ai # 

# A3 A3 V2 A4 Ai # 
####### 



# # # # 

# X X # 

#A,A# 
#A,A# 

# # # # 



a: Hi 



A a; B ^b; Vi 



#### 
#XX# 

#### 



for 1 < i < 4 



## # # # 
^ B Hi Hi # 

## # # # 



6, for 1 < i < 2 



### 

# S # 

# V. # 
#Vi# 

### 



6, for 1 < i < 2. 



Pi = 



a ah a a 

b bbb b 

a a b a a 

a a b a a 



Fig. 1. Tile grammar Gi (top) and a picture pi (bottom) of Example 1. 



recall that | ] denotes the set of tiles contained in the argument picture. This notation is 
preferable to the listing of all tiles, shown next: 



# # 
#A, 



# # 
Ai Ai 



Ai Vi 
Hi Vi 



Vi A2 
Vi H2 



A4 A4 

# # 



# # 



6 



An example of derivation is shown in Figure 2, where partitions are outiined for read- 
abihty. 



sssss 
sssss 
sssss 

s s s s s 



Ai Ai 


Vi 
Vi 


A2 A2 




Hi Hi 


H2H2 


A; A3 
A3 A, 


V2 
V2 


Aa A4 
Ai Ai 





Ai Ai 


Vi 
Vi 


A2 A2 


Hi Hi 


H2 H2 


X X 


V2 
V2 


Ai Ai 
Ai Ai 


A3 A3 



Ai Ai 


Vi 
Vi 


A2 A2 


Hi Hi 


H2H2 


A 


X 


V2 
V2 


Ai Ai 
Ai Ai 


A3 A3 



Ai Ai 


Vi 
Vi 


A2 A2 


Hi Hi 


H2H2 


A 


a 


V2 
V2 


Ai Ai 
Ai Ai 


As As 



Ai 


Ai 


Vi 


A2 A2 


Hi 


Hi 


Vi 


H2 H2 


a 


a 


V2 


Ai Ai 


A3 


As 


V2 


Ai Ai 



a 


a 


b 


a 


a 


h 


h 


b 


b 


b 


a 


a 


b 


a 


a 


a 


a 


b 


a 


a 



Fig. 2. Derivation using grammar Gi of Example 1, Figure 1, with outlined partitions. 



Example 2. Pictures with palindromic rows. Each row is an even paUndrome over {a,b}. 
The grammar G2 is shown in Figure 3. 



Sp 



# # # # 

# R R # 
Sp Sp 

# Sp Sp # 

# # # # 



[###### 

R-^ # A RRA' # 
[###### 

[## # # 

R-^ #AA'if^ 

[## # # 
a; B ^ b; A' 



####■ 

#RR# 
#### 



######■ 

# B R RB' # 
######. 

## # # 
#BB' # 

## # # 
B' 



a; 



b. 





abb 


a 




baa 


b 




a a a 


a 



Fig. 3. Tile grammar G2 (top) and a picture p2 (bottom) of Example 2. 
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3.1 Properties of tile grammars 



First, we state a language family inclusion between tiling systems (Definition 5) and tile 
grammars, proved in [4]. We will illustrate it with an example, both to give the reader 
an intuitive idea of the result, and to later re-use the example. 

Proposition 1. C{TS) c £(TG). 

Consider a TS T = {E, F, 0, tt), where E is the terminal alphabet, is a tile-set, 
r is the tile-set alphabet, and n : F —t- E is an alphabetic projection. It is quite easy 
to define a TG T' such that L{F') = L{T). Informally, the idea is to take the tile-set 
9 and add two markers, e.g. {b, w} in a "chessboard-Uke" fashion to build up a tile-set 
suitable for the right part of the variable size starting rule; other straightforward fixed 
size rules are used to encode the projection n. 

We note how both C{TS) and C{TG) are closed under intersection with the class of 
all height- 1 pictures: the classes resulting in that intersection are the well-known classes 
recognizable and context-free, respectively, string languages. The inclusion is hence 
proper: any context-free, non-recognizable string language is also (when considered as 
a picture language) in C(TG), but not in C(TS). 

The next example illustrates the reduction from a TS to a TG. 

Example 3. Square pictures of a's. 

The TS T3 is based on a local language over {0, 1} such that all pixels of the main 
diagonal are 1 and the remaining ones are 0, and on the projection 7r(0) = 7r(l) = a. 
T3 and the equivalent TG G3 are shown in Figure 4. 

The "chessboard-like" construction is used to ensure that the only strong homoge- 
neous partition obtained in applying a rule is the one in which partitions correspond 
to single pixels. This allows the apphcation of terminal rules encoding projection tt. 
Note that in the first rule of grammar G3 we used tiles arising from the two possible 
chessboard structures, i.e. the one with a "black" in top-left position, and the one with 
a "white" in the same place. Indeed, to fill areas above and below the diagonal with O's 
we need both tiles 



Ob 


0^, 


and 


0„, Ob 


0«; 


Ob 


Ob 0^ 



The following complexity property will be used to separate the TG language family 
from several subfamilies to be introduced. 

In this paper as "parsing problem" we consider the problem of deciding if a given 
input picture is in L{G), for a fixed grammar G (i.e. the also called non-uniform mem- 
bership problem). The complexity of parsing algorithms is thus expressed in term of the 
size of the input string, in this case the picture size. 

Proposition 2. The parsing problem for C{TG) is NP-complete. 

Proof From Proposition 1 and the fact that the parsing problem for C{TS) is NP- 
complete (see [14] where tiling systems are called homomorphisms of local lattice lan- 
guages, or [13]) it follows that parsing C{TG) is NP-hard. 
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Gs : S 



# 1 # 

# 1 # 

# 1 # 

# 1 # 

###### 



"###### 

# lb Qw Ot Oto # 

# Oto li Ow Of, # 

# 06 0™ u o„ # 

# 0^ 06 o„ u # 

###### 



7r(0) = o, 7r(l) 



######■ 

# Ito 06 Oto Ot # 

# 06 1,,, 06 0^ # 

# Oto 06 111) 06 # 

# 06 Oto 06 lu; # 
######. 



a, l6 — > a, Ou, — > ffl, 06 — >^ a. 



Fig. 4. For Example 3 the TS defining {a*"'"-' | n > 1} (top), and the equivalent TG grammar 
(bottom). 



For NP-completeness, we show that parsing C{TG) is in NP. First, we assume without 
loss of generaUty that a TG G does not contain any chain rule, i.e. a rule of the form 



#### 
#### 



B gN 



that corresponds to a renaming rule of a string grammar. 

If this is not the case, it is possible to discard chain rules by directly using the well- 
known (e.g. [12]) approach for context-free string grammars. 
We suppose to have a candidate derivation 

dom(p)) (Pi,7ri) (P2,7r2) • • • (p„-i,7r„_i) ^g (p,umt(j?)) 

and we are going to prove that checking its correctness takes polynomial time in h, k 
(size of the picture), by considering the dominant parameters of time complexity. 
First, the length n of this derivation, since there are no chain rules, is at most h ■ k. 
In fact, we start from a partition with only one element coinciding with dom(p), and at 
each step at least one element is added, arriving at step n, where the number of elements 
is /i • fc, each corresponding to a pixel. 

For each step, we must find the application area in (pi,Tri), and the corresponding 
rewritten nonterminal A, by comparing {pi, tTj) with (pj+i, tTj+i). The number of com- 
parisons to be performed is at most h- k. 

Then, we have to find a rule A ^ uj in R which is compatible with the rewritten sub- 
picture of pi+i corresponding to the application area. So, at most we must check every 
rule in R, and every tile of its right part, on a subpicture, given by the application area. 
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which is at most h ■ k. Hence, we have to consider for this step a number of checks that 
is at most 

h-k-\R\- max Iwl 

Each of these considered steps can be done in polynomial time in every reasonable 
machine model, hence the resulting time complexity is still polynomial. □ 

From [4] it is known that the family of TG languages is closed w.r.t. union, col- 
umn/row concatenation, column/row closure operations, rotation, and alphabetic map- 
ping. 

We mention that all the famihes presented in this work, that exactly define the 
context-free string languages if restricted to one dimension (i.e. all but tiling systems 
and grid grammars, presented in Section 5.3), are not closed w.r.t. intersection and 
complement. This is proved as for string context-free languages: it is straightforward 
to see that they are all closed w.r.t. union. But it is well known that the language 
{a"&"c" I n > 0} is not context-free, and can be expressed as intersection of two 
context free languages, e.g. {a"6™c" | m, n > 0} and {o"6"c"' \ m,n > 0}. Hence, 
they are not closed w.r.t. intersection, but this also means that they are not closed w.r.t. 
complement. 

4 Regional tile grammars 

We now introduce the central concept of regional language, and a corresponding spe- 
ciahzation of tile grammars. The adjective "regional" is a metaphor of geographical 
political maps, where different regions are filled with different colors; of course, re- 
gions are rectangles. 

Regional tile grammars are central to this work, because they are the most general 
among the polynomial-time parsable grammar models considered in this paper. We will 
see that it is easy to define the other kinds of 2D grammars by restricting the tUes used 
in regional tile grammars. 

Definition 9. A homogeneous partition is regional (HR) iff distinct (not necessarily 
adjacent) subdomains have distinct labels. A picture p is regional ;/ it admits a HR 
partition. A language is regional if all its pictures are so. 

For example, consider Figure 5: the partitions in subdomains of the picture on the 
left is homogeneous and strong, but not regional, since four different subdomains bear 
the same symbol A. On right, a variant of the same picture with regional partitions 
outlined is depicted. 

Another (negative) example is in Figure 4: "chessboard-like" pictures admit unique 
homogeneous partitions, i.e. those in which every subdomain corresponds to a single 
pixel. Note that in general these partitions are strong (adjacent subdomains have differ- 
ent symbols, like in a chessboard), but are not regional (e.g. in the variable size rule of 
grammar G3 there are multiple Oh symbols). 

Definition 10. A regional tile grammar (RTG) is a tile grammar (see Definition 6), in 
which every variable size rule uj is such that LOG {on) is a regional language. 
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A A 
A A 


B 
B 
B 


A A 
A A 


D D 


D D 


A A 
A A 


C 

c 


A A 
A A 



A-L 


Ai 


B 


A2 A2 


A-i 


Ai 


B 


A2 A2 


Di 


Di 


B 


D2 D2 


As 


A3 


C 


Ai A4 


A3 


A3 


C 


A4 A4 



Fig. 5. Pictures with outlined partitions in subdomains: strong homogeneous partition (left), and 
regional (right). 



We note that the tile grammars presented in Examples 1 and 2 are regional, while 
the one of Example 3 (Gs) is not. Another RTG is presented in the following example. 

Example 4. Misaligned palindromes. 

A picture is a "ribbon" of two rows, divided into four fields: at the top-left and 
at the bottom right of the picture are paUndromes as in Example 2 (where rules for 
Sp are defined). The other two fields are filled with c's and must not be adjacent. The 
corresponding regional tile grammar G4 is shown in Figure 6. 



G4 



"######## 

# Pi A Pi Pi Ci Ci # 

# C2 C2 P2 P2 P2 P2 # 
######## 



### ## 
=lf^ C Ci Ci # 

## # # # 



Pi->5p; P2 



c, for 1 < i < 2; C c. 



P4 



aabbaacccc 
ccbabaabab 



Fig. 6. Regional tile grammar G4 (top) and a picture p4 (bottom) of Example 4. 



Next, we study the form of tiles occurring in a regional local language. 
Consider a tile set 6 over the alphabet 17 U {#}. For a tile t we define the horizontal 
and vertical adjacency relations 'Ht,Vt C (Z" U {#})^ over its pixels t{i, j) as 

Vi, 1 < i < 2, t{i, 1) 7^ t{i, 2) ^ t{i, 1) Ht t{i, 2); 

Vi, 1 < j < 2, t{l,j) ^ t{2,j) ^ t{l,j) Vt t{2,j). 

Then, the adjacency relations are At=T-Lt^ Vt and A!f = U Vt- 

The relations can be extended to a tile set 9: xHey iff 3t G ^ : xHty, and similarly for 

Ve, Ae, and A'g. 

Proposition 3. Letp € and 9 = Ipj; picture p is regional iff the incidence graphs 
of both Ae Ci S"^ and A!^ n S'^ are acyclic. 
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We will call simple regional such a tile set. 

Proof First of all, we note that tiles occurring in regional pictures have the following 
form (or a rotation thereof): 



A A 




A A 




A A 




A B 




## 




## 




## 


A A 


1 


B B 




BC 




CD 








A A 




A B 



with A, B, C, D all different. The incidence graphs of the adjacency relations of this 
tile-set are clearly all acyclic. Moreover, a picture exclusively made of these kind of 
tiles admits a unique strong homogeneous partition. So, if we start from a regional 
picture p, we obtain acycUc incidence graphs for the tile-set made of all its tiles. 

Vice versa, if we consider a tile set such that its adjacency relations are both 
acyclic, then tiles in 9 must be like those considered in the previous paragraph. Also, 
for any picture in L0C{6), an acyclic Ae means that any path going from the top- 
left corner and arriving to the bottom-right corner and performing only down and right 
movements cannot traverse two distinct subdomains bearing the same label. For A'e it is 
analogous, but starting from the top-right comer, arriving to the bottom-left comer and 
performing only left and down movements. But this means that LOC{0) is a regional 
language. □ 

Proposition 4. A local language L is regional iff there exist some simple regional tile 
sets Oi, 02, ■ ■ ■ , On, n > 1, such that L = Ui<i<n LOC{9i). 

Proof If 6 is not simple regional, then it is possible to find a cycle in one of the in- 
cidence graph, let it be A, Bi, B2 ■ ■ ■ Ba, A. We consider now all the tiles determin- 
ing each edge of the cycle (e.g. for the first step of the cycle, all tiles containing an 
A and a Bi that are vertically or horizontally adjacent). Call such tiles ti,t2, ■ ■ ■ jh, 
with b > a + 1. Clearly, the tile sets 6i = 9 \ {ti}, 1 < i < 6, are such that 
Ui<i<b LOC{9i) C LOC{9). Let us suppose that there exists a picture pb in LOC{9) 
containing all the tiles ti, \ < i < b . But this means that Jpb] is not simple regional, 
because by construction the tiles ti determine a cycle on one of the incidence graphs of 
the adjacency relations, so p^ is not regional. Hence, L0C{9) = Ui<i<6 LOC{9i). 

Now let us consider the tile sets 9i; if they are all simple regional, we are done. If 
not, we repeat the same constraction, until we are able to find the desired 9'^, 9'2, ■ ■ ■ , 
9'^. The procedure always terminates, since 9 is finite. □ 

Thanks to this result and without loss of generality^, in the rest of the paper we will 
always consider regional tile grammar were the right parts of type (2) rales are simple 
regional. In practice, right parts will be written as where g is a bordered regional 
picture. 

4.1 Parsing for regional tile grammars 

To present our version of the Cocke-Kasami- Younger (CKY) algorithm [23], we have 
to generaUze from substrings to subpictures. Like the CKY algorithm for strings, our 

X ^ generates the same language as the rules X ^ Oi \ 62 \ ■ ■ ■ \ On- 
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algorithm works bottom-up, by considering all subpictures of the input picture, starting 
from single pixels (i.e. 1x1 subpictures), and then increasing their size. As a substring 
is identified by the positions of its first and last characters, a subpicture is conveniently 
identified by its subdomain. For simphcity and without loss of generality, we assume 
that the regional tile grammar considered does not contain variable size chain rules. 

The algorithm's main data structure is the recognition matrix, a four-dimensional 
matrix, holding lists of nonterminals, that the algorithm fills during its run. A nontermi- 
nal A is put into the matrix entry corresponding to subdomain d, if the same nonterminal 
can derive the subpicture spic(p, d). 

To decide if a rule can be used to derive the subpicture corresponding to subdomain 
d, the right part of the rule is examined, together with all the subdomains contained in 
d. Type (1) rules are easily managed, because they can only generate single terminal 
pixels, therefore they are considered only at the beginning with unitary subdomains. 
For example, let us consider grammar Gi of Example 1 (Figure 1), and its derivation 
shown in Figure 2. The pixel at position (3, 2) is an a, and the only possible generating 
terminal rules are X ^ o and A — >^ a. So we enter both X and A into the recognition 
matrix at (3, 2; 3, 2). 

For type (2) rules we need to check all the pictures in LOC{uj), isometric to the 
considered subpicture. Thanks to the regional constraint, every nonterminal used in the 
right part of the rule corresponds to a unique homogeneous rectangular area, if the 
rule is applicable. So we examine all the sets of nonterminals stored in the recognition 
matrix for all the subdomains contained in d: if we are able to find a set of subdo- 
mains which comply with the adjacency relations of the right part of the rule, then 
the rule is applicable. For example, let us consider the subdomain (3, 1; 3, 2) for the 
derivation of Figure 1. Subdomains (3, 1; 3, 1) and (3, 2; 3, 2) have already been consid- 
ered, being "smaller", and the set {A, X} has been entered at positions (3, 1; 3, 1) and 
(3, 2; 3, 2). This means that, if we consider X at (3, 1; 3, 1), and A at (3, 2; 3, 2), then 
all the adjacency relations of the type (2) rule for X in Figure 1 are satisfied (namely, 
#^ A AnX, Xn#, =ffVA, AV#, #VX, XV#). So the algorithm places X 
into (3, 1; 3, 2), since subpicture (3, 1; 3, 2) can be parsed to X. 

Remark: in the pseudo-code, loops over sets that are Cartesian product are to be per- 
formed in lexicographic order. For example, when stated e.g. 

for each e {1,...,10} x {3, 5, . . . , 11}.- . . . 
the control variables of the loop (i.e. i and j in this case) will respectively assume the 
following sequence of values in turn: (1, 3), (1, 5), . . . , (1, 11), (2, 3), (2, 5), . . . , (10, 11). 

We now present the details of the algorithm. Let p be a picture of size (m, n), to be 
parsed with a regional tile grammar G = (S, N, S. R). 

Definition 11. A recognition matrix 9Jl is a 4-dimensional m x n x m x n matrix over 
the powerset ofN. 

Being a generalization of the CKY algorithm for string, the meaning ofAGDJl{i,j;h,k) 
is that A can derive the subpicture spic(]3, h, fc)). In fact, only cells h, k), with 
h > i,k > j, are used: these cells are the four-dimensional counterpart of the upper 
triangular matrix used in classical CKY algorithm. 
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We introduce another data structure, the subdomains vector, to be used for recog- 
nizing the applicabiUty of type (2) rules. 

Definition 12. Consider a recognition matrix IDt, and a subdomain d = k, I). Let 
the nonterminal set N be arbitrarily ordered as Ai,A2, . . . , The subdomains 

vector 2) (d, DJl) is the Cartesian product Di x D2 x . . . x -D|Ar|, where every Dt is the 
set of subdomains d' such that At £ 9Jt((i') and d' is a subdomain contained in d; if Dt 
is empty, then its conventional value is set to (0, 0; 0, 0). 

For any nonterminal A, the notation D{d, £Dt) | a denotes the component of the vec- 
tor corresponding to A. 

To simplify the notation, we shall write D{d) instead of 2)(fi, 2t) at no risk of 
confusion, because the algorithm refers to a unique recognition matrix 9Jl. 

The main role of this ancillary data structure is to assign all the subdomains con- 
tained in a given subdomain d, to nonterminals, if possible, by considering the already 
filled portion of SBT. Using 2), we are able to check if the adjacency relations of rules 
are satisfied. For example, if a rule A ^ a demands A2'Ha-^&, then we only have to 
check if one of the elements of 2)(c?) has components 2 and 8 that are horizontally ad- 
jacent, with the domain corresponding to nonterminal A2 to the left. Figure 7 shows the 
procedure used to compute vector D. 

It is important to remark that S) is central for keeping the time of the parsing algo- 
rithm polynomial w.r.t. the input size. Indeed, in a regional tile grammar the number of 
possible homogeneous subdomains to be considered for a candidate application area is 
at most \N\, because the number of used "colors" in the right part of a rule is at most 
the number of nonterminals of the grammar, and when we are considering each element 
of we know that it has size less than (m^n^)'^'. In principle, it would be possible 
to adapt this algorithm also to an unrestricted tile grammar, but in this case the number 
of elements to be considered could be exponential, as the number of different homoge- 
neous subdomains could be at most as big as the number of pixels of the apphcation 
area (see e.g. grammar G3 in Figure 4). 

Procedure ComputeD{M, (i, j; k, 1)): 

Every set in D is empty; 

for each G {i,...,fc} x {j, ...,/}: 

for each (fe',/') G {i',...,k} x {j',...,/}: 
for each e ajr(i',/; A;', «'): 

put k', I') into the set D|a; 

for each A € N: 

if 2)|a = then put (0, 0; 0, 0) into the set S)|a; 

return 2). 

Fig. 7. Computes) 
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The actual procedure for checking if a rule of the grammar can be applied to a given 
rectangle k, I) is presented in Figure 8. Based on the vector D, computed for the 
relevant subdomain {i, j; k, I), the procedure checks, for a right part w of a variable-size 
rule, if all adjacency constraints are satisfied. 

Procedure CheckRule (S, cj, (i, j\ k, I)) : 
for each (di, d2, . . . , rf|jv|) £ 3); 

/ := True; 

for each {Na,Ni,) € H^: 

it da = (ia,ja;ka,la) and dt = (ib,jb; kb,lb) are not such that 

jb = la + h and kb > ia, ka > ib, 

then / := False; 
for each {Na,Nt) e V^: 

it da = (ia,ja; kaja) and db = {ib,jb; kb,lb) are not such that 

ib = ka + 1, and h > ja, L > jb, 

then / := False; 
for each (#, iV„) en^- 

it da = (iaja, ka, la) and jo =^ j then / := False; 
for each (iVa,#) G Uu.: 

if da = {ia,ja;ka,la) and io Zthen/ := False; 
foreach(#,iVa) € Vu.: 

if da = {ia,ja\ ka, la) and ia ^ i then / := False; 
for each (Ara,#) € V^: 

if da = {ia,ja; ka, la) and ka^k then / := False; 
if / then return True; 

return False. 



Fig. 8. CheckRule 

The Main procedure, presented in Figure 9, is structured as a straightforward gen- 
eralization to two dimensions of the CKY parsing algorithm. The input picture p is in 
L{G) mSe m{l,l;m,n). 

Correctness and complexity of parsing We start with a technical lemma, used to 
prove the correctness of the CheckRule procedure. 

Lemma 1. Let co be a regional set of tiles and d a subdomain. CheckRule( to, d) returns 
true iff there exists a rule C — >■ w, such that {po, ttq) =>g {Pi,'^i), where d G ttq, and 
spic(po5 d) is a C -picture. 

Proof By construction, a true output of CheckRule(w, d) is equivalent to the fact that 
there exist q G LOC{uj) and a partition of d into the subdomains di,d2, ■ ■ ■ ,dr, such 
that: 

1. every spic(g, dj) is an A-picture, for some nonterminal A e SDT(dj); 
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Procedure Main: 
Every set in Tt is empty; 
for each pixel p{i, j) = t: 

if there exists a fixed size rule A ^ t £ R, 
then put A into the set j; i, j); 

for each {v, /i) € {1, . . . , m} x {1, . . . , n}: 

for each € {1, . . . ,m — v} x {1, . . . , n — /i}: 
2) := Computes) (OH, {i, j; k, /)); 
for each variable size rule {A^ w) € R: 

if CheckRule(T> , (jj,{i,j;i + v — l,j + h— 1)), 
then put A into the set 93l(i, j; i + v — l,j + h— 1); 

return 9Jl. 

Fig. 9. Main 

2. if spic(g, dj) is an ^-picture, then for no dk dj the subpicture spic(g, dk) is an 
A-picture. 

This means that iT(g) ® d is the HR partition {di ,d2, ■ ■ ■ ,dr}. Moreover, starting from 
(po, TTo), where spic(po, d) is a C-picture, it is possible to apply a rule C — >■ w in a 
derivation step (po, tto) (pi, 7I"i), where ttq = {d,d[,d'2, . ■ . , d'^}, tti = {rfi, 4, 
. . . , cZjj}U {c?i, ^2, ■ • • , dr}, and g = spic(pi, d) G LOC{oj). □ 

After this, the correctness is easy to prove, analogously to the ID case [23]. 

Theorem 1. m{d) = {A&N\A^g spic(p, d)}. 

Proof The proof is by induction on derivation steps. 

Base: d ^ This means that |spic(p, = (1, 1). Hence, ^4 =>g spic(p, d) 

iff A spic(p, d) G R. This case is handled by the first loop of procedure Main, the 
one over each pixel p(j, j). If spic(p, d) = t, and there exists a rule A ^ t, then the 
algorithm puts A into 3Jl((i). Vice versa, A G Dyi{d) means that the algorithm has put 
A in the set, therefore there must exist a rule A spic(p, d). 

Induction: let us consider d = {i,j;i + v—l,j + h — l),v > 1, or /i > 1, 
or both. We prove that A =I>g spic(p, d) implies A G DJl^d). In this case, the size 
of the subpicture is not (1,1), therefore the first rule used in the derivation A ^g 
spic(p, d) is a variable size rule A ^ uj. Thanks to the two nested loops with control 
variables (u, h) and when the algorithm considers d, it has already considered 

all its subdomains di,d2, . . . ,dk- By the induction hypothesis, for every 1 < j < k, 
B 4>G spic(p, dj) implies B G ^{dj). Hence (Lemma 1), CheckRule(w, d) must be 
true, and the algorithm puts A in 9Jl(d). 

Next, we prove that A G 9Jt((i) implies A ^g spic(p, d). A G 3Jl(d) means that 
procedure Main has put A in the set. Therefore, CheckRuleCw, d) must be true. Thanks 
to Lemma 1 , this is equivalent to the existence of an applicable variable size rule A — > w 
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for the first step of the derivation A 4>g spic(p, d). The rest of the derivation holds by 
induction hypothesis. □ 



Theorem 2. The parsing problem for C{RTG) has temporal complexity that is poly- 
nomial with respect to the input picture size. 

Proof First, it is straightforward to see that Computed) performs a number of opera- 
tions that is O (\N\ ■ m^'n?). 

Let us now consider the CheckRule procedure. This procedure performs a loop for 
each element of the subdomains vector, which contains a number of elements that is 
less than (m^n^) 1^1, and nested loops on V.^ and Vui- Therefore the number of check 
performed by it is dominated by a value that is 



Coming finally to the Main procedure, we note that its core part consists of two 
nested loops, over two sets that are at most m. ■ n each. The body of these two loops 
consists in a call to ComputeS), and then another loop over the grammar rules, com- 
prising a call to CheckRule (hence the dominant part). 

Therefore, the number of operations performed is at most 



Each of these operations can be done in polynomial time in every reasonable machine 
model, therefore the resulting time complexity is polynomial w.r.t. the picture size. □ 

The property of having polynomial time complexity for picture recognition, united 
with the rather simple and intuitively pleasing form of RTG rules, should make them a 
worth addition to the series of array rewriting grammar models conceived in past years. 

5 Comparison with other language families 

In this section we prove or recall some inclusion relations between grammar models 
and corresponding language families. To this end we rely on the examples of Section 4, 
and on the separation of complexity classes. 

We start by comparing regional tile grammars and tiling systems. To this end, we 
adapt a proof and an example introduced by Prusa in [18]. 

Example 5. Consider a language Lu over the alphabet E = {0, 0', 1, 1', x, x'} where 
the "primed" symbols are used on the diagonal. A picture p is in Lu if, and only if: 

1. p is a square picture of odd size; 

2. p{hj) G {0, 1, x}, when i ^ j; p{i,j) G {0', 1', x'}, otherwise. 

3. p{i,j) G {x, x'} iff I and j are odd; 

4. if p{i,j) G {1, 1'} then the «-throworthej-thcolumn(orboth)ismadeof symbols 
taken from {1, 1'}. 





2 2 

m n 
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An example picture is shown in Figure 10. Primed symbols by definition appear only 
on the main diagonal, and are used to have only square pictures. It is quite easy to see 
that Lit is a locally testable language, definable through a set of 3-tiles. 
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Fig. 10. A picture of the language Lu of Example 5 



Proposition 5. C{RTG) and C{LT) are incomparable. 

Proof First, we know from [11] that C{LT) C C{TS), and that the non-TS language 
of palindromes, used in [4] to prove that tiling systems are strictly included in tile 
grammars, is also a RTG language, obtained by a 90° rotation of Example 2. 

To end the proof, we need a language that is in C{LT) but not in C{RTG). Let 
G = {S, N, S, R) be a RTG such that L{G) = Lu of Example 5. W.l.o.g., we assume 
that R does not contain chain rules. We consider a natural number n = 2fc + 1 big 
enough to comply with the requirements presented in the rest of the proof. 

First, let Li be {p e Lu \ \p\ = (n,n)}. Clearly, \Li\ = 2"~\ audit contains at 
least [2"~^/|i?|] pictures that can be generated in the first step by the same rule. 

We now fix a rule, e.g. S ^ a, and let L2 be the subset of L\ generated by this rule. 
In a n by n picture, the number of possible partitions in homogeneous subpictures is less 
than (n^)l^l. This means that there exists a set Z/3 C L2, having size IL3I > ^^y^i \ N \ 
such that every picture in it was generated by G starting with the same rule S ^ a, and 
such that the initial S'-homogeneous picture was replaced by the same s G LOG (a) . 

Depending on the chosen rule's right part, i.e. a, we now identify a row or a column 
of the picture in an odd position, and call it A. We have two cases: either (1) every 
s € LOG (a) is made of homogeneous subpictures having all both width and height 
less than n; or (2) in every s € LOG (a) there is at least one homogeneous subpicture s' 
having width or height equal to n (but clearly not both, because we are not considering 
chain rules). In case (1), let A be the first row. In case (2), let A be one of the rows or 
columns in an odd position and completely contained in s'. 

Let L4 be a subset of L2 such that every picture in it has the same A. Because of 
its definition, if we fix an odd row of pictures in Lu, then columns of even indexes that 
are completely filled by 1 and 1' are determined by it (if we fix an odd colunm, it is 
analogous but with rows). Hence, IL4I < . 

We can assume that n is sufficiently large so that IL3I > IL4I, i.e. there is at least a 
picture in L3 which is not present in L4. So we are able to find in L3 two pictures p and 
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q that are generated by the same initial rule, S ^ a, with the same initial strong homo- 
geneous partition (the one determined by s), and such that A in p is different from A in 
q. Now consider all the subpictures of p and q that are in the positions corresponding 
to the initial strong homogeneous partition. Of these subpictures, we consider only the 
sets P' = {pi,P2! • • • ^iid Q' = {gi, ■ ■ ■ T<l'j}^ with i,j < \N\, that contain A 
in p and in q, respectively. If we replace in pi all the elements of P' with the elements 
in Q', we obtain a picture which is derivable from S ^ a, but it is not in L^, because 
it contains columns (or rows in some cases (2)) that are not compatible with the fixed 
A. □ 

The fact that C{LT) c C{TS) implies the following statement. 

Corollary 1. C{RTG) and C{TS) are incomparable. 

This last result, together with the facts that RTG rules are a restricted form of TG 
rules, and that C{TS) C C{TG), gives us the following: 

Corollary 2. C{RTG) C C{TG). 



5.1 Context-free Kolam grammars 

This class of grammars has been introduced by Siromoney et al. [22] under the name 
"Array grammars", later renamed "Kolam Array grammars" in order to avoid confusion 
with Rosenfeld's homonymous model. Much later Matz reinvented the same model [15] 
(considering only CF rules). We prefer to keep the historical name, CF Kolam grammars 
(CFKG), and to use the more succint definition of Matz. 

Definition 13. A sentential form over an alphabet V is a non-empty well-parenthesized 
expression using the two concatenation operators, Q and (D, and symbols taken from 
V. ST{V) denotes the set of all sentential forms over V. A sentential form cp defines 
either one picture over V denoted by (|0D, or none. 



For example, — {{a © 6) G (6 ® a)) e SJ^{{a, b}) and (|(/)iD is the picture 



a 


b 


b 


a 



On the other hand ^2 = ((a CD 6) a) denotes no picture, since the two arguments of 
the operator have different column numbers. 

CF Kolam grammars are defined analogously to CF string grammars. Derivation 
is similar: a sentential form over terminal and nonterminal symbols results from the 
preceding one by replacing a nonterminal with some corresponding right hand side of 
a rule. The end of a derivation is reached when the sentential form does not contain 
any nonterminal symbols. If this resulting form denotes a picture, then that picture is 
generated by the grannmar. 

Definition 14. A context-free Kolam grammar (CFKG) is a tuple G = {E, N, S, R), 

where S is the finite set of terminal symbols, disjoint from the set N of nonterminal 
symbols; S £ N is the start symbol; and R C N x ST{N U E) is the set 0/ rules. A 
rule {A, (p) G R will be written as (p. 
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For a grammar G, we define the derivation relation =>c on die sentential forms 
SJ^{N U E) by ipi =>G V'2 iff tiiere is some rule A ^ cj), such that V'2 results from tpi 
by replacing an occurrence of A by (p. As usual, =I>g denotes the reflexive and transitive 
closure. Notice that the derivation thus defined rewrites strings, not pictures. 

From the derived sentential form, one then obtains the denoted picture. The picture 
language generated by G is the set 

HG) = m I V e SJ'iS), s 4>G 

With a slight abuse of notation, we will often write A 4>g P, with A G N,p € S~^~^, 

instead of 30 : A =»g 4>j d^D = P- 

It is convenient to consider a normal form with exactly two or zero nonterminals in 
the right part of a rule [15]. 

Definition 15. A CF Kolam grammar G = {S,N,S, R), is in Chomsky Normal Form 
iff every rule in R has the form either A ^ t, or A ^ B Q G, or A ^ B (D G, where 
A,B,C G N, and t G S. 

We know from [15] that for every CFKG G, if L{G) does not contain the empty 
picture, there exists a CFKG G' in Chomsky Normal Form, such that L{G) = L{G'). 
Also, the classical algorithm to translate a string grammar into Chomsky Normal Form 
can be easily adapted to CFKGs. 

Example 6. The following Chomsky Normal Form grammar G5 defines the set of pic- 
tures such that each colunnn is an odd length palindrome. 

S ^V(DS\AieA2\BieB2\a\b 

V ^ AieA2\ BieB2\a\b 

A2-^VQAi\a 

B2^VeBi\b 

Ai a 

El b. 

Comparison with other models First, we sketchily and intuitively show that the orig- 
inal CF Kolam definition is equivalent to the one introduced by Matz. The following 
description is directly taken from [22]. 

Let G = {E, N, S, R), be a Kolam context-free grammar, where N = NiU N2, Ni 
a finite set 0/ nonterminals, N2 a finite set 0/ intermediates, S a finite set 0/ terminals, 
i? = i?i U -R2 U -R3, i?i a finite set 0/ nonterminal rules, R2 a finite set 0/ intermediate 
rules, i?3 a finite set 0/ terminal rules. S G Ni is the start symbol. 
Ri is a set of pairs {A,B) (written A ^ B), A G Ni, B G {Ni U N2)+^ or B G 
(iVi U iV2)+e. 

R2 is a set of pairs {B, G), B G N2, G G {N2U {xi,X2,- ■ ■ , a^fc})^®, 

with Xi, - ■■ ,Xk G \Xi\row = \xi+l\row, I < i < k; 

or G G {N2 U {xi,X2, - ■• ,Xk})^'^, with Xi, - ■■ ,Xk G S++, \xi\coi = \xi+i\coi, 
l<i<k. 
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i?3 is a set of pairs {A, t), A € [NiVJ N2) and t G 



(Derivation) If A is an intermediate, then the intermediate language generated by A is 

iV/^ — \pC I A XjX G "^iZ^i,*** ^Xl^y~^^jXj G '~)|»^i|rou; — |rou;? 1 ^ ^ ^ 

k}or Ma = {x \ A^ x,x e {xi,--- ,.Tfe}+©,.Tj G S++,\x,\coi = |.x,+i|co(,l < 
i < k}. Derivation proceeds as follows. Starting from S, nonterminal rules are applied 
without any restriction as in a string grammar, till all the nonterminals are replaced, 
introducing parentheses whenever necessary. Now replace for each intermediate A in 
N2 elements from Ma, subject to the conditions imposed by (D, Q. The replacements 
start from the innermost parenthesis and proceeds outwards. The derivation comes to 
an end if the condition for or ® is not satisfied. 

Grammar G5 of Example 6 complies with this definition. In it, Ai and Bi are inter- 
mediates. 

It is very easy to see that the original definition of CF Kolam grammars is equiva- 
lent to the new one given by Matz. Right part of rules are made of vertical or horizontal 
concatenations of nonterminals or fixed terminal pictures. So we can define an equiva- 
lent grammar that is as stated in Definition 14, by translating the right part of rules that 
contain terminal pictures xi,X2, ■ ■ ■ ,Xp, decomposing each picture a;^ in a sentential 
form (j) such that Xi = ^4)). Vertical or horizontal concatenations are then treated anal- 
ogously (e.g. we translate AB into [A CD B)). Clearly, we do not need to distinguish 
nonterminals from intermediate symbols. 

Proposition 6. C{CFKG) c C{RTG). 



Proof In [4] a construction is given to prove that a CF Kolam grammar (in the form 
defined by Matz [15]) can be transformed into a TG. It turns out that the TG thus 
constructed is a RTG. 

Sketchily, consider a CF Kolam grammar G in CNF. Rules A — > t,t G i7 are 

identical in the two models and generate the same kind of languages (i.e. single terminal 
symbols). Rules A ^ S (D C of G are equivalent to RTG rules having the following 
form: 

[######] 

#BBCC# 

4B BC C# 
[######] 

Rules A — > B 9 G of G are equivalent to RTG rules having the following form: 

####] 
#BB# 
#BB# 
#CC# 
#CC# 
####] 

The inclusion is strict, because the language of Example 1 was shown by Matz [15] 
to trespass the generative capacity of his grammars. □ 
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The fact that the picture recognition problem for CF Kolam grammars has been 
recently proved [5] to be polynomial in time of course follows from the above inclusion 
property and from Theorem 2. 

For the special case of CF Kolam grammars in Chomsky Normal form (CNF), we 
note that the parsing time complexity is 0{'nn?v?{m + n)) [5]. Some of the reasons of 
this significant difference are the following. Kolam grammars in CNF are much sim- 
pler, because in the right part of a rule there are at most two distinct nonterminals. So, 
checking if a rule is applicable has complexity which is linear with respect to the picture 
width or height. 

5.2 Prusa's context-free grammars 

In the quest for generality, D. Prusa [18] has recently defined a grammar model that 
extends CF Kolam rules, gaining some generative capacity. The model is for instance 
able to generate the language of Example 1 . 

Defuiitions The following definitions are taken and adapted from [17, 18]. 

Definition 16. A 2D CF Prusa grammar (PG) is a tuple (17, A'^, S, R), where E is the 
finite set o/terminal symbols, disjoint from the set N o/ nonterminal symbols; S £ N is 
the start symbol; and RC N x {N U is the set o/ rules. 

Definition 17. Let G = {S, N, S, R) be a PG. We define a picture language L{G, A) 
over Sfiyr every A G N. The definition is given by the following recursive descriptions: 

(i) If A w is in R, and w € ^7++, then w G L{G, A). 

(ii) Let A wbe a production in R, w = {NU i?) /or some m,n>l. Letpij, 
with l<i<m, l<j< n, be pictures such that: 

L ifw{i,j) G S, then Pi J = w{i,j); 

2. ifw{i,j) G A'', thenpij G L{G,w{i,j)); 

3. let Pk = pks (D Pk,2 CD • • • CD Pk,n- For any 1 < i < m, 1 < j < n, \Pi,j\col = 
\Pi+i,j\coi; andP = PiQP2e---ePm- 

Then P G L{G, A). 

The set L{G, A) contains all and only the pictures that can be obtained by applying 
a finite sequence of rules (i) and (ii). The language L(G) generated by grammar G is 

defined as the language L{G, S). 

Informally, rules can either be terminal rules, in this case managed exactly as tile 
grammars or Kolam grammars, or have a picture as right part. In this latter case, the 
right part is seen as a "grid", where nonterminals can be replaced by other pictures, but 
maintaining its grid-like structure. Note that the grid meshes may differ in size. 

Example 7. The grannmar G^ of Figure 1 1 generates the language of pictures with one 
row and one colunm of 6's in a background of a's (see Example 1). 

We now introduce a normal form for Prusa grammars: 

Definition 18. A Prusa grammar G = (E, N, S, R), is in Nonterminal Normal Form 
(NNF) iff every rule in R has the form either A ^ t, or A ^ w, where A G N, 
w G A''++, and t G E. 
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AV A 

H b H, A^ AM \M, M ^ \a, 
AV A 

V ^ y \ b, H^bH\b. 
Fig. 11. PG Ge of Example 7. 

Comparison with other models To compare Prusa grammars with tile grammars, we 
note that the two models are different in their derivations. Tile grammars start from a 
picture made of S"s having a fixed size, and being every derivation step isometric, the 
resulting picture, if any, has the same size. On the other hand, Prusa grammars start 
from a single S symbol, and then "grow" the picture derivation step by derivation step, 
obtaining, if any, a usually larger picture. 

First, we prove that the language of Example 4 cannot be defined by Prusa gram- 
mars, so the language families of regional tile grammars and Prusa grammars are dif- 
ferent. To this aim, we use a technique analogous to the one introduced for proving 
Proposition 5. 

Proposition 7. C{PG) ^ C{RTG). 

Proof Let G = [S, N, S, R) be a PG such that L(G) = L{Gi), where G4 is the RTG 
presented in Example 4. W.l.o.g. we assume that E does not contain chain rules, and 
consider a natural number n big enough to comply with the requirements of the rest of 
the proof. First we consider Lq c L{Gi), on alphabet {a, c}, where the palindromes 
are made exclusively of a symbols. Suppose that pictures in are generated by a rale 
S ^ A,B & N An this case it is easy to see that A must generate strings a*c^, with 
i + j = n, while B generates strings c^^a', k + I = n. But it is possible to take i < k, 
thus obtaining pictures that are not in L{G4). So we can assume that the starting rules 
are hke S ^ w, with w having at most two rows and at least two columns. 

Now consider Li c L{G4), in which every picture has two rows, 3n columns, and 
is such that the two c-homogeneous subpictures in it have size (1, n); hence \Li \ = 2^". 
The set Li contains at least [2^"/|i?|] pictures that can be generated in the first step by 
the same rule. 

We fix a rule, e.g. S w, with \w\ = {a,b), 1 < a < 2, b > 1, and let L2 be the 
subset of Li generated by this rule. W.l.o.g. we assume that n > b,so each nonterminal 
in w generates a subpicture (that in the rest of the proof we will index by pij, 1 < i < a, 
1 < J < having at most two rows and one column. Being the number of different 
sequences \pi,i\coi, bi,2 coif ■ ■ ■ \Pl,b\coh \pi,i\row, \P2,i\row limited by 2(3n)'' (each 
|Pi,i|coi is less than 3n and at most there are two rows), there exists a subset -L3 of L2, 
having size jLaj > 2^"/ (2|i?|(3n)*'), in which for any two pictures p and p', and for 
every ?', j, \pij \ is equal to j. 

Let L4 be a subset of L2 such that every picture in it is like ^„ , g« ' '•^^ central 
third of the picture is made of two equal rows). Clearly, \L4\ < 2". 
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We can assume that n is large enough so that | L3 1 > | L4 1 . But this means that in L3 
there are two different pictures p = ' °r , and p' = ' „ with q s, q' ^ s', 

c s s c s s 

and (1) q q' 01 (2) s 7^ s'. We know that & > 1, so if we replace pi 1 and p2.i (if 
a = 2) in j3 with p[ ^ and i' case (1), we obtain a picture generated by G that is not 
in L{Gi). Case (2) is analogous, but considers the right part of p, i.e. and p2,b- □ 

Indeed, Prusa grammars can be seen as a restricted form of regional tile grammars, 
as stated by the following proposition. 

Proposition 8. C{PG) c C{RTG). 

Proof Consider a PG in NNF G. First of all, we assume without loss of generality that 
for any rule, nonterminals used in its right part are all different. If this is not the case, 
e.g. assume that we have a rule 

A ^ ^ 

Z X' 

then we can rename one of the X symbols to a freshly introduced nonterminal X', and 
then add the chain rule X' ^ X. 

Let us define a RTG G" equivalent to G. Terminal rules are easily treated. For a 
nonterminal rule of G, e.g. 

. . . Bi^k 



Bh,i ■ ■ ■ Bh^k 



we introduce the following rule in G': 



# # # • 

# -Bi.i -Bi.i • 



# Bh,i Bh,i 

# Bh,i Bh,i 

# # # 



• # # # 

• -Bi.fe -Bi.fe # 



# # # 



Note that each nonterminal Bi^j is repeated four times in the right part of the rule, so to 
, that can be used to "cover" a rectangular area of any size. 



have the tile 



Bi^j Bij 
Bi,j Bij 



Essentially, Prusa grammars can be seen as RTG's with the additional constraint 
that tiles used in the right parts of rules must not have one of these forms: 



AB 
GC 



A G 
BG 



GG 
AB 



C A 
G B 



with A, B, G all different. 
Proposition 9. C{GFKG) c C{PG). 
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Proof For containment, it suffices to note that the constraints on tiles of the corre- 
sponding tile grammar, introduced in the proof of Proposition 8, are a weaker form of 
the constraints used for proving Proposition 6. 

The contairmient is strict, since Prusa grammar can generate the language of one 
column and one row of b's in a field of a's (see Example 7), while CF Kolam granmiar 
cannot [15]. □ 

5.3 Grid grammars 

Grid grammars are an interesting formalism defined by Drewes [7], [8]. Grid grammars 
are based on an extension of quadtrees [9], in which the number of "quadrants" is not 
limited to four, but can be k^, with k >2 (thus forming a square "grid"). 

Following the tradition of quadtrees, and differently from the other formaUsms pre- 
sented here, grid grammars generate pictures which are seen as sets of points on the 
"unit square" delimited by the points (0,0), (0,1), (1,0), (1,1) of the Cartesian plane. 
The following definitions are taken (and partially adapted) from [8]. 

Let the unit square be divided by a evenly spaced grid into k^ squares, for some 
k>2.A production of a grid picture grammar consists of a nonterminal symbol on the 
left-hand side and the square grid on the right-hand side, each of the k"^ squares in the 
grid being either black or white or labelled with a nonterminal. 

A derivation starts with the initial nonterminal placed in the unit square. Then pro- 
ductions are applied repeatedly until there is no nonterminal left, finally yielding a 
generated picture. As usual, a production is applied by choosing a square containing 
a nonterminal A and a production with left-hand symbol A. The nonterminal is then 
removed from the square and the square is subdivided into smaller black, white, and 
labelled squares according to the right-hand side of the chosen production. The set of 
all pictures generated in this manner constitutes the picture language generated by the 
grammar. 

A picture generated by a grid picture grammar can be written as a string expression. 
Let the unit black square be represented by the symbol B, and the white unit square by 
W. By definition, each of the remaining pictures in the generated language consists of 
k^ subpictures tti^i, . . . TTi^t, ■ ■ ■ T^k.i, • • • , T^k.k, each scaled by the factor 1/k, going 
from bottom-left tti^i to top right i^k,k- Iftij is the expression representing iTij (for 
1 < iji < k), then [ti,i,- ■ ■ , . . . , tfe,i, • • • , tfe.fe] represents the picture itself (for 
k = 2it is a quadtree). 

In order to compare such model, in which a picture is in the unit square and mono- 
chromatic, with the ones presented in this work, we introduce a different but basically 
compatible formalization, in which the generated pictures are square arrays of symbols, 
and the terminal alphabet is not limited to black and white. 

Deiuiitions To define grid grammars, we use a technique similar to the one used for 
Kolam grammars in Section 5.1. 

Definition 19. For a fixed k > 2, a sentential form over an alphabet V is either a 
symbol a & V, or [ti^i, . . . , • • • , tk,i, ■ ■ ■ , tk,k], o.nd every tij being a sentential 
form. SJ^{V) denotes the set of all sentential forms over V. 
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A sentential form </> defines a set of pictures 

- I\a\j, with a G V, represents the set {a}("'"\n > 1 of all a-homogeneous square 
pictures; 

- (\\ti^i, . . . , ti^/c, . . . , tk,i, . • • , tfe,fc]D, represents the set of all square grid pictures 
where every has the same size n x n, for n > 1, and is at the bottom- 
left corner, (|fi,feD is at the bottom right corner, and (|ffe,feD is at the top right 

corner. 

Note that we maintained in the sentential forms the original convention of starting 
from the bottom-left position. For example, consider the sentential form 

= [[a, 6, [a, 6, 6, a] , c] , a, i?, [6, a, a, 6]] . 

The smallest picture in is depicted in Figure 12. 



BBBBaabb 

BBBBaabb 
BBBBbbaa 
BBBBbbaa 

b a c c a a a a 
a b c c a a a a 
a a b b a a a a 
a a b b a a a a 



Fig. 12. Example picture generated by the form [[o, 6, [o, 6, b,a\,c],a,B, [b, o, a,b]]. 



Definition 20. A grid grammar (GG) is a tuple G = {S, N, S, R), where S is the finite 
set o/ terminal symbols, disjoint from the set N o/ nonterminal symbols; S G N is the 
start symbol; and R C N x SJ^{N U S) is the set o/ rules. A rule {A, (j)) & R will be 
written as A^ (j). 

For a grammar G, we define the derivation relation =>g on the sentential forms 
SJ^{N U E) by ipi =>a V'2 iff there is some rule A ^> 0, such that ip2 results from 
tpi by replacing an occurrence of A by (f>. As usual, =I>g denotes the reflexive and 
transitive closure. As with Kolam grammars, the derivation thus defined rewrites strings, 
not pictures. 

The derived sentential form denotes a set of pictures. Formally, the picture language 
generated by G is the set 

L{G) = {p e W I V- G ST{S),S 

In the literature, parameter k is fixed for a grid grammar G, i.e. all the right parts 
of rules are either terminal or fc by A; grids. This constraint could be relaxed, by al- 
lowing different k for different rules: the results that are shown next still hold for this 
generalization. 

It is trivial to see that grid grammars admit the following normal form: 
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Definition 21. A grid grammar G = {S, N, S, R), is in Nonterminal Normal Form 

(NNF) iff every rule in R has the form either A ^ t, or A ^ i • • • ) -Bi,fe, . . . , Bk^i, 
. . . , -Bfc,fc], where A, Bij e A'', and t € E. 

Example 8. Here is a simple example of a grid grammar in NNF. 

S ^ [S,B,S,B,B,B,S,B,S], S ^ a, B^h. 

The generated language is that of "recursive" crosses of 6's in a field of a's. Figure 
13 shows an example picture of the language. 

ahahbbaaa 
bbbbbbaaa 
ababbbaaa 
bbbbbbb b b 
bbbbbbbbb 
bbbbbbb bb 
ababbbaaa 
bbbbbbaaa 
ababbbaaa 



Fig. 13. A picture of Example 8. 



Comparison witli otlier models First, we note that this is the only 2D grammatical 
model presented in this paper which cannot generate string (i.e. ID) languages, since all 
the generated pictures, if any, have the same number of rows and columns by definition. 

It is easy to see that the class of languages generated by grid grammars are a proper 
subset of the one of Prusa grammars. In fact, a grid grammar can be seen as a particular 
kind of Prusa grammar, in which symbols in right part of rules generate square pictures 
having the same size. 

Interestingly, the same construction can be applied also to CF Kolam grammars. 

Proposition 10. C{GG) c C{CFKG). 

Proof For simplicity, let us consider a grid grammar G = {S, N, S, R) in NNF. 

(i) For terminal rules A ^ t,t G S,we introduce the following rules in the equivalent 
CF Kolam grammar G': 

A^ {A(D A^) e {Ah(Dt) \t, Ah ^ Ah(Dt\t, Ay^teA^\t 

where A^ , Ay are freshly introduced nonterminals, not used in other rules. It is easy 
to see that these rules can only generate all the square pictures made of t's. 
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(ii) For nonterminal rules A [Bi^i, . . . , -Bi,fe, . . . , -Bfe,i, ■ • ■ , -B/c,fe], we add the fol- 
lowing "structurally equivalent" kind of rules: 



{Bk,i CD ■ ■ ■ (D Bk,k) 

e 



e 

® • • • ® Si,fe) 



To show the equivalence L{G) = L{G'), we use induction on derivation steps. As 
base case, we note that terminal rules of G are equivalent to the rules of G' introduced 



Induction step: consider a nonterminal rule Uke in (ii). By induction hypothesis, 
all Bi j of G' generate languages equivalent to their homonym in G, and all made 
of square pictures. But by definition of 0, |(-Bj,i CD • • • ® -Bj,/c)|coi = |(-Bj+i,i ® 
■•• ® Bj^i^k)\coU for all 1 < j < A;. Moreover, by definition of ®, \Bj^i\row = 
\Bj^i-i\row, for all 1 < i < fc. Being all squares, this means that the sentential form 
® • • • ® Bk,k) e • • • e (-Bi,i ® • • • ® Bi^k) of G' generates a picture iff every 
Bi^j have the same size. But this also means that it is equivalent to the sentential form 



The inclusion is proper, because by definition grid grammars cannot generate non- 



5.4 Context-free matrix grammars 

The early model of CF matrix grammars [2 1 ] is a very limited kind of CF Kolam gram- 
mars. The following definition is taken and adapted from [19]. 

Definition 22. Let G = {H, V) where H = (Z", A^, 5, R) is a string grammar, where 
N is the set of nonterminals, R is a set of productions, S is the starting symbol, E' = 
{Ai,A2, • • • , Ak}, V is a set of string grammars, V = {Vi, V2, - ■ • , Vk} where each 
Ai is the start symbol of string grammar Vi. The grammars in V are defined over a 
terminal alphabet S, which is the alphabet of G. A grammar G is said to be a context- 
free matrix grammar ( CFMG) iffH and all Vi are CF grammars. 

Let p G 17++, p = ci (I) C2 (I) ■ • ■ (D Cn. p S L{G) iff there exists a string 
Axi Ax2 ■ • ■ Ax^ G L{H) such that every column Cj, seen as a string, is in L(14^ ), 1 < 
j < n. The string A^^ A^^ ■ ■ ■ A^^ is said to be an intermediate string deriving p. 

Informally, the grammar H is used to generate a horizontal string of starting sym- 
bols for the "vertical grammars" Vj,l < j < k. Then, the vertical grammars are used 
to generate the columns of the picture. If every column has the same height, then the 
generated picture is defined, and is in L{G). 

Example 9. The language of odd-width rectangular pictures over {a, b}, where the first 
row, the last row, and the central column are made of 6's, the rest is filled with a's is 
defined by the CFMG Gj of Figure 14. 



at(i). 




square pictures (e.g. string languages). 



□ 
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Gr = {H,{Vi,V2}) where 
H : S ^ AiSAi I A2 
Vi : Ai ^ bA; A^ aA\b; 
Vi : Ai^ bA2 I b. 



P7 = 



b b bbb b b 
a a a b a a a 
a a a b a a a 
a a a b a a a 
a a a b a a a 
bbbbbbb 



Fig. 14. CF matrix grammar G7 of Example 9 (top), and an example picture (bottom). 

Comparison witli otlier grammar families First, we note that it is trivial to show that 
the class of CFMG languages is a proper subset of CF Kolam languages. 

Proposition 11. £{CFMG) C C{CFKG). 

Intuitively, it is possible to consider the string sub-grammars G, and Gj, of a CF 
matrix grammar M, all in Chomsky Normal Form. This means that we can define an 
equivalent M' CF Kolam grammar, in which rules corresponding to those of G use only 
the CD operator, while rules corresponding to those of Gj use only the operator. 

Also, it is easy to adapt classical string parsing methods to matrix grammars [19]. 

Proposition 12. C{GFMG) and C{GG) are incomparable. 

Proof First, we know that by definition Grid grammars can generate only square pic- 
tures. On the other hand, it is impossible to define CF matrix grammars generating only 
square pictures. This is because classical string pumping leimnata can be applied both 
to G (the "horizontal component" of the grammar), and to Gj, 1 < j < k (see e.g. 
[16]). Therefore the two language classes are incomparable. □ 

6 Summary 

We finish with a synopsis of the previous language family inclusions, and a presentation 
of the constraints on the tile set of tile grammars corresponding to each class. 




Tile grammars 




Tiling systems 



Locally testable languages 



Prusa grammars 



Local languages 
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Prusa grammars 



Prusa grammars in NNF are regional tile grammars with the constraint that tiles used in 
right part of rules must not have one of these forms: 



AB 




A C 




c c 




C A 


CC 




BC 




AB 




C B 



with A, B, C all different nonterminals. (See Proposition 8.) 



CF Kolam grammars 

CF Kolam grammars in CNF can be seen as regional tile grammars such that the tile-sets 
used in the right parts of rules must have one of the following forms: 

[####] 

[######1 #^^# |####] 
^AABB# #AA# #AA# 
#AABB# ' #BB# ' #AA# 

[######1 #BB# |[####J 
[####J 

with A^ B. (See Proposition 6.) Clearly, this is also compatible with the constraint of 
Prusa grammars. 



Grid grammars 

For grid grammars in NNF, we have the same constraints on nonterminal rules as in 
CF Kolam grammars. Moreover, there is a different treatment of terminal rules of the 
grid grammar, i.e. rules like A ^ t^t & S. The corresponding regional tile grammar 
rules (still maintaining the CF Kolam grammars constraints) are used to generate from 
A square t-homogeneous pictures of any size, and are the following: 



# # # # 

# ^1 # 

# ^1 # 

# ^2 ^2 # 

# # # # 



Ax 



### # # 
#AAA^4 
#AAA^# 
### # # 





■# # 


# 


# #■ 




"# # #1 


A2 




Ai 




1 






# # 


# 


# # 




# # # 



# # # 

# # # 



# # # 

# # # 



^ t. 
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with Ai,. . . all freshly introduced nonterminals. In practice, we are using the CF 
Kolam grammar rules corresponding to terminal rules of grid grammars of Proposition 
10, translated into regional tUe grammar rules following the construction of Proposition 
6. 

CF matrix grammars 

Following the construction sketched in Section 5.4 for proving that CF matrix gram- 
mars define a subset of the class defined by CF Kolam grammars, we note that the tile 
constraints are exactly the same of CF Kolam grammars. The added constraint is that if 
a nonterminal C is used as left part of a "horizontal" rule 

######1 

#AABB# 

then it shall not be used as left part of a "vertical" rule 

####1 
#AA^ 
#AA# 
#BB# 
#BB# 
####J 

and vice versa. (This is a direct consequence of the informal considerations at the be- 
ginning of Section 5.4 and the proof of Proposition 6.) 

From all that, regional tile grammars prove to be useful as a unifying, not overly 
general, concept for hitherto separated granmiar models. 
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